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ABSTRACT 

Set  Packing  and  Set  Partitioning  Problems  belong  to  the  class  of  0-1  integer  programming  problems  that  are 
NP-complete.  Packing  problems  are  a  class  of  optimization  problems  in  mathematics  which  involves  attempting  to  pack 
objects,  as  densely  as  possible  but  optimally,  many  applications  arise  having  the  packing  and  partitioning  structure. 
Delivery  and  routing  problems,  scheduling  problems  and  location  problems,  switching  theory,  wireless  network  design, 
VLSI  circuits  and  line  balancing  often  take  on  a  set  packing  structure,  if  one  wishes  to  satisfy  as  much  demand  as  possible 
without  creating  conflict  and,  if  every  customer  must  be  served  by  exactly  one  server,  the  problem  takes  on  a  set 
partitioning  format.  The  Set  Packing  Problem  has  a  dual  covering  problem,  which  asks  how  many  of  the  same  objects  are 
required  to  completely  cover  every  region  of  the  container,  where  the  objects  are  allowed  to  overlap.  In  this  paper  a 
linearization  technique  is  developed  to  solve  packing  problems  with  non-linear  objective  function,  in  particular  the 
quadratic  objective  function.  This  is  an  extension  of  the  work  done  by  Saxena  and  Arora  [19].  The  algorithms  redeveloped 
in  this  paper  are  supported  by  numerical  examples. 

MATHEMATICAL  SUBJECT  CLASSIFICATION:  65K05,  90C10 
KEYWORDS:  Set  Packing,  Quadratic  Set  Packing,  Set  Partitioning 
1.  INTRODUCTION 

Packing  problems  can  be  related  to  real  life  packaging,  storage  and  transportation  issues.  The  set  packing  and 
partitioning  problems  with  linear  functions  has  been  studied  by  Garfinkel  and  Nemhauser  ([9],  [14]),  Roth[17],  Lemke, 
Salkin  and  Speilberg  [13],  Bellmore  and  Ratliff  [2],  Chvatal  [6]  and  Balas  ([2],  [3]).  They  discussed  and  developed  various 
enumeration  techniques  for  these  problems. 

In  the  year  1977,  Arora  and  Puri  [1]  discussed  the  enumeration  technique  for  the  set  covering  problem  with  linear 
fractional  function  as  its  objective  functions.  Extending  their  work,  in  the  year  1998,  Saxena  and  Arora[20]  discussed  a 
cutting  plane  technique  for  multi-objective  fractional  Set  Covering  Problem,  Saxena  and  Arora  ([18],  [19])  also  discussed 
linearization  technique  for  solving  the  Quadratic  Set  Covering  Problem  and  an  enumeration  technique  for  solving  multi 
objective  linear  Set  Covering  Problem.  Later  in  the  year  2013  Saxena  and  Gupta  ([10],  [22])  worked  on  Set  Covering, 
Packing  and  Partitioning  problems  with  Quadratic  Fractional  and  Linear  Fractional  objective  functions 

There  are  many  applications  of  quadratic  set  packing  problems  in  real  life. 

One  of  which  is  coming  from  medicine,  is  the  following:  we  want  to  determine  if  an  illness  can  be  related  to  some 
other  medical  parameters  of  patients,  such  as  finding  a  correlation  between  heart  attack  and  cholesterol  for  instance. 
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To  analyze  this,  we  collect  data  on  these  parameters  for  both  ill  and  healthy  people.  More  formally,  each  person  gives  data 

on  several  criteria  (weight,  cholesterol,  etc.)  and  is  represented  as  a  point  in  R"  (n  is  the  number  of  criteria).  Thus  we  have 

a  setS+  of  positive  points  (ill  people)  and  a  set  5  of  negative  points  (healthy  people).  A  first  step  in  the  analysis  of  the 
data  produces  a  collection  of  the  positive  and  negative  patterns.  A  positive  (respectively  negative)  pattern  is  a  hypercube 

in  R"  which  contains  no  negative  points  (no  positive  points).  This  collection  is  such  that  every  point  is  packed.  From  a 
medical  point  of  view,  we  would  like  to  find  a  sub-collection  of  patterns  such  that,  every  point  is  packed  and  the  volume  of 
interactions  between  positive  and  negative  patterns  is  as  large  as  possible  (for  criteria  relevance). 

Now  define /z^  as  the  volume  of  the  interaction  between  the  positive  pattern  S*  e  S+   and  the  negative 

pattern  5  -G  S  ,  then  the  problem  is  to  find  a  packaging  of  all  points  such  that  ^  h-S^S  ■  is  to  be  maximized. 

ij 

The  above  instance  results  in  a  Quadratic  Set  Packing  Problem. 

In  this  paper  the  objective  function  would  be  a  quadratic  function.  The  present  technique  involves  the  linearization 
of  a  Quadratic  Set  Packing  and  Partitioning  problems  till  the  optimal  solution  is  obtained. 

Consider  the  class  of  problems  having  the  following  structure: 

MinDX 

AX  >  e 

Xj  =  0  or  1  for  j=l,...,n 

T 

Where  A  is  a  mxn  matrix  of  zeroes  and  ones,  e  =(l,...,l)isa  vector  of  m  ones  and  D  is  a  vector  of  n  (arbitrary) 
rational  components.  This  pure  0-1  linear  programming  problem  is  called  the  Set  Partitioning  Problem,  when  the 
inequalities  are  replaced  by  equations.  When  all  of  the  >  constraints  are  replaced  by  <  constraints  with  maximized 
objective  function,  the  problem  is  called  the  Set  Packing  Problem. 

2.  THEORETICAL  DEVELOPMENT 

Considering  the  basic  structural  format  of  the  problem  this  section  is  divided  into  two  sections: 
2.1  Set  Packing  Problems 

Consider  a  set  /  =  {1, 2, m)  and  a  set  P  =  {Pv  P2, Pn } ,  where  P.  C  /  for  each  ye  /  =  {1, 2,...,n}. 
A  subset    J  of  J  is  said  to  be  a  pack  of   /  if  [J  Pj  =  I,  and  j&keJ*,j^k    andi>  f)Pk=0.   Let  a 

weight  Cj  >  0  be  associated  with  every  j'e  /.  The  total  weight  of  the  pack  /  is  equal  to  ^  C  ■ . 

The  Quadratic  Set  Packing  Problem  (QPkP)  is  to  find  a  packing  of  maximum  weight  subject  to  the  condition  that 
at  the  most  one  of  the  utility  is  satisfied.  Mathematically,  the  problem  is 
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n  n 


(QPkP)  MaxZ(=  f(X))  =Y,djxj+H  Hhjkx.ixk 

7=1  M  k=\ 

n 

Subject  to  X  auX  <  1,  i  £  I  (2.1) 

7=1 

Xj  =0  or  1,  je  J  (2.2) 

fl         if  j  is  in  the  pack  fl         zj  f  g  P- 

Where  X .  =  <  and       a..  =  < 

[0         otherwise  [0  otherwise 

It  is  assumed  that  ft  „ '  5  are  elements  of  the  nxn  symmetric  negative  semi  definite  matrix  H  =  (hjk  )  .  In  matrix 
form,  (QPkP)  can  be  written  as 

Max  Z(=  f(X))  =  DX  +  XTHX 
subject  to  AX  <  b 


row 


where   XT  =  (xl,x2,...,xn)  with  jc  •  =  0  or  1,  j  =  1,2,..., n.  Here  D  =  (d1,d2,...,dn)  G  i?"   is  a 
vector,  A  is  an  mxn  matrix  of  zeros  and  ones  and  bT  =  (1,1,. ..,1)  is  a  row  vector  of  ones. 
2.1.1.  Definitions 

•  Pack  Solution:  A  solution  X  which  satisfies  (2.1)  and  (2.2)  is  said  to  be  a  pack  solution. 

•  Redundant  Packing:  For  any  pack  J  ,  a  column  j  G  7  is  said  to  be  redundant  if  /  —  \j  }   is  also  a  pack. 
If  a  pack  contains  one  or  more  redundant  columns,  it  is  called  a  redundant  pack.  Column  j    is  redundant  with 

respect  to  the  pack  /  iff  ^  at-  <  2  for  all  /  G  P.. . 

7  *  T  * 

•  Prime  Packing  Solution:  A  pack  J   is  said  to  be  a  prime  pack,  if  none  of  the  columns  corresponding  to  J  G  J 
is  redundant.  A  solution  corresponding  to  the  prime  pack  is  called  a  prime  packing  solution. 

•  Pseudo  Concave  Function:  Let /be  a  differentiable  function  defined  on  an  open  set  T  d  R"  .  Let  S  (Z  T 

andXl,X2G  S  ,  then/is  said  to  be  pseudo  concave  if  Vf(X2)T(Xl  —  X2)  <  0  =>  /(Xj)<  f(X2). 

2.1.2  Following  Theorems  Forms  the  Basis  for  the  Technique  Developed 

Theorem  1:  [18]  If  7   =  {j  :  Xj ,  =  1}  is  any  prime  pack  of  (QPkP)  then  X  —  {Xj }  is  an  extreme  point  of  the 
convex  set  formed  by  feasible  region. 

Theorem  2:_If  the  objective  function  in  (QPkP)  has  finite  value  then,  there  exists  a  prime  packing  solution  where 
this  value  is  attained. 
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Proof:  Let  a  finite  optimal  solution  of  (QPkP)  exists  at  X  o  €  S  then  the  optimal  value  is 
f(Xo)  =  DXo+XoT  HXo. 

Let  JQ  be  the  pack  corresponding  to  the  solution  XQ  .  If  JQ  is  the  prime,  then  it  is  done,  otherwise  a  prime  pack 

can  be  derived  from  JQ  by  dropping  the  redundant  columns.  Let  Jl  be  the  prime  pack  obtained  from  JQ  and  X 1  be  the 
corresponding  solution  of  (QPkP)  such  that 

f(Xi)  =  DXi+XiT  HXi. 

Since  7i  C  Jo ,  therefore, 

DXi  +  XiTHXl  >DXo+XuTHXo. 

or  /(Xi)>/(Xo). 

As    f(Xo)    is   the   optimal   value   off(X),   therefore,    f(Xi)<  f(Xo).  Hence    f(Xi)  =  f(Xo). 
Which  proves  that  there  exists  a  prime  packing  solution  yielding  the  optimal  value  of  the  objective  function  of  (QPkP). 

Theorem  3:  Let  f(X)  be  a  pseudo  concave  function  defined  on  feasible  set  S  and  X   G  S  then  X  *  is  an 
optimal  solution  for  the  program 

Maximize  f(X) 

XeS 

if  and  only  if,  X  is  an  optimal  solution  for  the  program 


Maximize  Vf  (X' f  X 

XeS 

where  S  is  the  feasible  region. 

Proof:  Let  X  be  an  optimal  solution  for  the  program  (QPkP),  therefore,  f(X)>f(X),VXeS. 
f(X)  =  f(X*  +  X-X*) 

f(x*)+vf(x*f(x-x*)+a(x\x-x*)nx-x*n 

Where  a(X*,X-X*)^0  as  X  ->  X* 

Since  f(X*)>f(X)^Vf(X*)T(X-X*)  +  a(X*,X-X*)UX-X*[KO 
And  a(X*,X-X*)^0 
^Vf(X*)T(X-X*)<0 
^Vf(X*)T X  <Vf(X*f  X* 
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=>  X   is  an  optimal  solution  for  the  program  MaxVf(X  )T  X  . 

Conversely,        let        X         be        an       optimal        solution       of        MaxVf(X*)T  X  therefore, 
Vf(X*)TX*  >Vf(X*)X,VXe  S 

=>  Vf(X*)(X  -  X*)  <  0,  VX  e  S 

Since  /  is  a  pseudo  concave  function,  therefore,  f(X)  <  f(X  ),  VX  £  5  . 

Hence  A    is  an  optimal  solution  for  (QPkP). 

Theorem  4:  The  objective  function  in  (QPkP)  is  pseudo  concave. 

Proof:  Given  f(X)  =  DX+XTHX,XeS. 

Since  /  is     a    differentiable     function    over     an    open     set    containing     S ,     therefore,     for  any 
Xl,X2e  S  -  {X  e  R"  :  AX  <b,X  >  0}, 

(V/(X2)r(X1  -  Z2))  =  (D  +  2X*H)(XX  -  X2). 

=  D(X{  -X2)  +  2X2TH(Xl  -  X2). 

=  (DXl  -  DX2  +  2X2HXl  - 2X2HX2). 

=  (DXl  +  X*HXX)-  (DX2  +  X2HX2)  +  (2X2HXl  -  X2HX2  -  X'HXJ 
=  /(X,)-  f(X2)- (X,  -  X2)TH{XX  - X2). 

=>  Vf(X2 )T (X,  - X2)  +  (X,  -  X2  f  H{XX-X2)  =  fiX, ) -  f(X2). 

Since  H  is  a  negative  semi  definite  matrix,  therefore,  (Xx  —  X2)T H(Xl  —  X2)  <  0. 

Hence,  V/(X2  f  (X,  -  X2 )  <  0  =>  f{X{ )  -  f(X2)  <  0      f{X{  )<f(X2 ). 

Thus,  /  is  a  pseudo  concave  function  on  S. 
Following  algorithm  is  developed  to  enumerate  the  given  problem 
Algorithm 

Step-1:  Given  Quadratic  Set  Packing  Problem  (QPkP).  Form  the  corresponding  continuous  program  (QPkP')  by 
embedding  the  feasible  region  into  R"  (a  cube  with  n  vertices).  Let  S  be  the  feasible  set  for  (QPkP'). 
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Step-2:  Choose  a  feasible  solution  X0  €  S  such  that  Vf(X())  ^  0.  Form  the  corresponding  linear  program 
(LP). On  solving  (LP)  let  X{  be  its  optimal  solution.  If  Xv  =  XQ  and  is  of  the  0-1  form,  then  this  is  the  required  solution 
of  the  given  problem,  otherwise  let  Sx  =  { Xx } . 

Step-3:  Starting  with  the  point  X{ ,  form  corresponding  (LP),  let  its  optimal  solution  be  X2  ^  Xv  Update  5", 
i.e.  Sl  =  {Xl,X2}. 

Step-4:  Repeat  step  3  for  the  pointX2and  suppose  at  the  ith  stageSj  =  {Xl,  X2, Xt }  .Stop  if  at  the  (i+l)th 
stag  XM  G  Si ,  then  XM  is  the  optimal  solution  of  (QPkP'). 

Step-5:  If  Xj+lis  an  optimal  solution  of  the  form  0-1  then  it  is  a  solution  of  (QPkP)  otherwise,  go  to  Step-6. 

Step-6:  Apply  Gomory  cuts  to  find  a  solution  of  the  0-1  form  and  the  corresponding  prime  pack  solution. 

Note:  The  algorithm  must  terminate  after  finite  number  of  steps  as  it  moves  only  on  the  vertices  of  the  feasible 
region,  which  are  finite  in  number,  i.e.  convergence  is  must. 

2.3.2  Numerical  Example 

Consider  the  Quadratic  Set  packing  problem  (QPkP) 


"-3 

2 

4  " 

xi 

Max  f{x)  =    [30    20  10] 

x2 

+  [xt  x2  x3  ] 

2 

-4 

3 

x2 

-X3  _ 

4 

3 

-6 

_X3 

=  30xj  +  20 x2  +  10x3  - 3xf  -  4x2  -  6x3  +  Axxx2  +  Sx{x3  +  6x2x3 
subject  to      Xj  +  x2  <  1 
x2  +  x3  <  1 
Xj  +  x3  <  1 
0  or  1 

where  7  ={1,2,3}  ,  /  ={1,2,3} 

Here  the  objective  function  is  pseudo  concave  therefore  applying  the  algorithm  developed  above  to  this  problem 

(QPkP). 

The  corresponding  (QPkP')  is 

Max  fix)  =30X[  +  20x2  +  10x3  -  3X2  -  4x2  -  6x3  +  Axxx2  +  8xjX3  +  6x2x3 

3£  —        ?  "^2 '  "^3  )  ^  ^  —  {^"^1 '  "^2  '  "^3  ^  ^  "^2  ~     *^2  ~  "^3  ~  '  *^2  '  "^3  ~  ^  }  * 

Step-2.Choose  XQ  =  (1,0,0)  as  one  of  the  feasible  solution  of  (QPkP')  with  Vf(XQ)*0 
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The  corresponding  (LP)  is 

Maximize  Vf(X0)T  X  =  2Axx  +  2Ax2  +  lSx3 :  X  e  S. 

It  is  a  linear  problem  therefore  can  be  solved  by  simplex  method  i.e. 

Max  f(x)  =  24*j  +  24x2  +18x3 

3£  —  (-^j  j      '  "^"3  )  ^  ^  —  {^"^1 '  "^2  '  "^3    ^  "^1  _ ^"  "^2  "^2  _ ^"  "^3  ~     "^1  _ ^"  "^3  ~      "^1 '  "^2  '  "^3  ~  ^  } " 

Introduce  the  slack  variables  St  S2 ,  S3  in  order  to  convert  the  constraints  in  to  the  equality 
Max  f(x)  =  24xx  +  24x2  +lSx3  +  0s1  +  0s2  +  0s3 

-Vj  — \~  ^\  — 

-^2  ^2  —  ^~ 

X-^  ~ \~  ~ I-  iS"-^  —  1 

After  applying  the  simplex  algorithm  the  final  optimal  table  is  as  follows: 


Table  1 


24 

24 

18 

0 

0 

0 

CB 

B 

xB 

Yi 

Y2 

Y3 

Si 

s2 

s3 

24 

1 

0 

0 

1/2 

-1/2 

Vi 

24 

x2 

y% 

0 

1 

0 

1/2 

V% 

-1/2 

18 

X3 

Vi 

0 

0 

1 

-1/2 

Vi 

Vi 

33 

0 

0 

0 

15 

9 

9 

Hence  the  optimal  solution  is  (1  /  2, 1  /  2, 1  /  2)  ,  which  is  not  of  the  form  0  or  1,  therefore  apply  the  Gomory  cut 


to  get  integer  solution. 


The  cut  is  s4=  1 —  X,  H —  X,  H —  X, 

2     2  4    2  5    2  6 


Inserting  this  additional  constraint  in  the  optimal  simplex  table  the  next  iterative  table  is 


Table  2 


24 

24 

18 

0 

0 

0 

0 

CB 

B 

XB 

Yi 

Y2 

Y3 

Si 

S2 

S3 

s4 

24 

1/2 

1 

0 

0 

'/2 

-1/2 

Vi 

0 

24 

x2 

1/2 

0 

1 

0 

Vi 

1/2 

-1/2 

0 

18 

X3 

1/2 

0 

0 

1 

-1/2 

1/2 

¥2 

0 

0 

s4 

-1/2 

0 

0 

0 

-1/2 

-1/2 

-1/2 

1 

33 

0 

0 

0 

15 

9 

9 

0 

Now  apply  the  dual  simplex  method,  optimal  iterative  table  is 


Table  3 


9 

8 

9 

0 

0 

0 

0 

CB 

B 

XB 

Yi 

Y2 

Y3 

Si 

s2 

S3 

s4 

24 

X] 

1 

1 

0 

1 

0 

0 

1 

0 

24 

x2 

0 

0 

1 

0 

0 

0 

-1 

1 
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Table  3 


0 

s2 

1 

0 

0 

1 

0 

1 

1 

-1 

0 

Sl 

0 

0 

0 

-1 

1 

0 

0 

-1 

24 

0 

0 

6 

0 

0 

0 

24 

Hence  the  optimal  solution  of  (LP)  is  X{  =(1,0,0),  which  is  equal  toXQ  =(1,0,0),  therefore  this  is  the 
optimal  solution  for  the  original  (QPkP)  with  optimal  value  27. 

Note:  The  function  (-f)  is  said  to  be  pseudo  convex  if /is  pseudo  concave,  and  minimum  (-f)  =  maximum  f. 

Since  the  set  partitioning  problems  have  minimizing  objective  function  therefore  using  above  note,  the  algorithm 
so  developed  for  set  packing  problem  can  also  be  applied  to  set  partitioning  problems. 


2.2  Set  Partitioning  Problems 

The  Quadratic  Set  Partitioning  Problem  (QPP)  is  to  find  a  partition  of  minimum  cost  subject  to  the  condition  that 
exactly  one  of  the  utility  is  satisfied.  Mathematically,  the  quadratic  Set  Partitioning  Problem  is  problem  is- 

n  n  n 

(QPP)  MinZ(=  f(X))  =^X*;  Z 

7=1  7=1  *=1 

n 

Subject  to  ^^Xj  =1,  is  I  (2.3) 

;'=i 

Xj  =0  or  1,  j€  J  (2.4) 

f  1  if  j  is  in  the  partition  fl  if  i  €  P, 

Where  X :  =  \  and  a,  =  \ 

[0         otherwise  [0  otherwise 

It  is  assumed  that  d  . '  S  are  non-negative.  A  solution  X  which  satisfy  (2.3)  and  (2.4)  is  said  a  partition  solution. 

The  algorithm  developed  to  linearize  Set  Packing  Problems  is  used  to  solve  the  Partition  Problems  since  the 
objective  function  is  pseudo  convex.  Following  example  is  done  accordingly. 

2.2.1  Numerical  Example 

Consider  the  quadratic  partitioning  program  (QPP): 
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"3 

2 

4" 

X, 

Min  f(x)  =  [: 

3    2  1] 

x2 

1  ^  1 

2 

4 

3 

*3 

4 

3 

6 

x3 

=  3^j  +  2x2  +  x3  +  3xj2  +  4x2  +      +  4x^2  +  Sx{x3  +  6x2x3 
subject  to       x{  +  x2  =  1 

-^2  ~ ^~  -^3  —  1 

xpx2,x3  =  0  or  1 
Where  /  =  {1,2,3}  ,  ^  =  {1,2} 

Here  the  objective  function  is  pseudo  convex  therefore  applying  the  algorithm  developed  as  before  to  this  problem 

(QPP). 

The  corresponding  (QPP')  is 

Min  f(x)  =3xl  +  2x2  +  x3  +  3xf  +  Ax\  +  6x3  +  Axlx2  +  Sx{x3  +  6x2x3 

—  (-^i  j      '  "^3  )  ^  ^  —  {^"^1 '  "^2  '  "^3  )  ^  "^1  _ ^"  "^2  —     "^2  _ ^"  "^3  —      "^1 '  "^2  '  "^3  ~  ^  }  " 

Step-2.Choose  XQ  =  (0,1,0)  as  one  of  the  feasible  solution  of  (QPP')  with  V/(X0)  *  0 
The  corresponding  (LP)  is 

Minimze  Vf(XQ)TX  =  7x,  +  \0x2  +  7x3  :XeS. 

It  is  a  linear  problem  therefore  can  be  solved  by  simplex  method  i.e. 

Max  f(x)  =  -7xj  — 10x2  -7x3 

—  (-^j  j  "^2  '  "^3  )  ^  ^  —  {^"^1 '  "^2  '  "^3  )  ^  "^1  _ ^~  "^2  —      "^2      "^3  —      "^1 '  "^2  '  "^3  ~  ^  }  " 

After  applying  the  simplex  algorithm  the  final  optimal  table  is  as  follows: 


Table  4 


Cj 

-7 

CB 

B 

XB 

Yt 

Y2 

Y3 

-10 

1 

1 

1 

0 

-7 

x3 

0 

-1 

0 

1 

-10 

4 

0 

0 

Hence  the  optimal  solution  of  (LP)  is  Xx  =  (0,1, 0),  which  is  equal  to  X()  =(0,1,0)  therefore  this  is  the 
optimal  solution  for  the  original  (QPP)  with  optimal  value  1 . 

3.  CONCLUSIONS 

Mathematical  Programming  techniques  are  of  great  interest  and  importance  in  various  fields  where  an  objective 
function  is  to  be  optimized  under  certain  restrictions.  There  is  no  single  method  available  for  solving  an  optimization 
problem  efficiently.  Due  to  this  reason  a  number  of  enumerative  techniques  have  been  developed. 
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Rashmi  Gupta  &  Ratnesh  Rajan  Saxena 


Set  Packing  and  Partitioning  problems  belong  to  a  class  of  0-1  integer  programming  problems.  In  this  paper  an 
extension  of  the  earlier  result  [18]  to  set  partitioning  and  set  packing  problems  is  presented. 

The  proposed  linearization  technique  is  justified  analytically  by  mathematical  results,  the  algorithms  developed 
are  supported  by  numerical  examples. 
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